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PROGRESSIVE TWO-DIMENSIONAL (2D) PYRAMID FILTER 



BACKGROUND 

This disclosure is related to pyramid filter implementations. 

A filter bank may comprise M different filters, where M is a finite 
number and larger than 1. Because the filter bank may generate M 
different output signal samples substantially simultaneously from the 
same input signal sample or samples, it allows the capability to select a 
desired signal sample output from M signal sample outputs in real-time. 
The application of a filter bank is, therefore, popular in reprographics 
systems, such as photocopying machines, for example. Unfortunately, 
since the computation of such a filter is comphcated and the number of 
filters in a filter bank may also be large, the number of computations 
employed may be significant. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Subject matter is particularly pointed out and distinctly claimed in the 
concluding portion of the specification. The claimed subject matter, 
however, both as to organization and method of operation, together with 
objects, features, and advantages thereof, may best be understood by 
reference of the following detailed description when read with the 
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accompanying drawings in which: 

FIG. 1 is a diagram illustrating the coefficients for one-dimensional 
(ID) pyramid filters; 

FIG. 2 is a table of filter coefficients for a 5-filter pyramid filter bank; 

FIG. 3 is a table of input signal sample-filter coefficient products for a 
5-filter pyramid filter bank; 

FIG. 4 is a table of column filter data for an embodiment of a 5-filter 
progressive pyramid filter bank; 

FIG. 5 is a schematic diagram of an embodiment of a 5-filter two- 
dimensional (2D) progressive pyramid filter bank; 

FIG. 6 is a schematic diagram showing a portion of the embodiment 
of FIG. 5 in greater detail; 

and 

FIG. 7 is a table comparing a traditional 2D filter bank with an 
embodiment of a progressive 2D filter bank. 
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DETAILED DESCRIPTION 

In the following detailed description, numerous specific details are 
set forth in order to provide a thorough understanding of the claimed subject 
matter. However, it will be understood by tiiose skilled m the art that tiie 
claimed subject matter may be practiced without these specific details. In 
other instances, well-known methods, procedures, components and circuits 
have not been described in detail in order so as not to obscure the claimed 
subject matter. 

An embodiment for an efficient implementation of a progressive 
pyramid 2D filter bank is presented. In this embodiment, the number of 
computations and the execution time is reduced over traditional two- 
dimensional (2D) pyramid filter bank implementations. Furthermore, 
hardware and software implementations of this particular embodiment 
are disclosed. 

As is well-known, a pyramid filter is a special filter. Its 
coefficients form two arithmetic series and are symmetric to the center 
coefficient. For a one-dimensional finite pyramid filter with (2n -1) 
coefficients, its coefficients may be represented by a 1 x (2n - 1) matrix 
[Ci, C2, C3, Cn-i, Cn, C„.i, C3, C2, Ci]; where, n is a positive 
integer and C2 - Ci = C3 - C2 = . . . = - Cn-i- For its corresponding 
two-dimensional separable filter, the coefficients may be represented by 
the product of a (2n - 1) x 1 and a 1 x (2n - 1) matrix using the elements 
from the one-dimensional filter. 
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Typically, a filter bank is comprised of a number of pyramid filters 
and their filter lengths are 3, 5, 7, 9, and so on. The coefficients of these 
filters also may have the following features: 

1. All are positive integers. 

2. The smallest coefficient is 1 and is the first and last coefficient in the 
coefficient series. The largest coefficient is dependent on the number 
of filter taps, or filter length, and is the center coefficient. 

3. The difference between any two consecutive coefficients is 1. 

FIG. 1 illustrates the coefficients of various one-dimensional pyramid 
filters in a filter bank. In this context, one-dimensional pyramid filters 
and two-dimensional separable pyramid filters are referred as ID-filters, 
and 2D-filters, respectively. 

The ID-filter output signals, in the form of signal samples, is the 
product of its input data and filter coefficients. Eq. 1 and Eq. 2, below, 
respectively show how to compute the output signal samples of a 3-tap 
colunm and a 3-tape row ID-filter, respectively. Eq. 3, below, shows 
how to compute the output signal samples of a 3-tap 2D-filter, 
designated Yi j, by using a 2D-filter. Eq. 4, below, shows how to 
generate the output signals of a 3-tap 2D-filter output, designated Zij, by 
using, instead, two ID-filters, one as a column filter and another as a 
row filter. This is possible because a 2D pyramid filter in this context 
comprises a separable function, which allows the computation of a 2D 
transformation in two operations, first by a row- wise ID transformation 
of rows followed by a column- wise ID transformation of columns. 
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although the order of operations may also be reversed. Comparing Zj j 
with Yij, they are the same; however, applying a two- ID-filter scheme 
has the following advantages: 

1 . ID-matrix multipHcation is simpler than 2D-matrix 
multiplication. 

2. ID-column-filter output signal samples are reusable for the next 
ID-row-filter computations. 

Since the column-filter data is reusable, to compute an N X N filter 
involves computing one new column-filter from raw data £ind one row- 
filter from the column-filter output signal samples as long as the other 
previous (N-1) column-filter output signal samples exist. As described in 
more detail hereinafter, this makes computation easier. 
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A traditional 2D-filtering scheme will typically use multiplication 
and addition, for software implementation, or a multiplier-and- 
accumulator (MAC), for hardware implementation, to implement 
column and row-filter computations. 

Generally, a filter bank with M output signal samples has N = 2M 
+ 1 input signal samples or coefficients. Here, the coefficients of a N- 
tap ID-filter are denoted Ci, C2, . . . Cn, the input data are denoted Di, 
D2, . . . Dn, the column-filter data are denoted Ki, K2, ... Kn, and the 
2D output signal samples are denoted On- In accordance with the 
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description above, to get 2D-filter output data or signal samples, one 
column-filter output signal sample, Kn, and one row-filter output 
signal sample. On, are computed from the previous column-filter 
output signal samples, Ki, K2, ... Kn-i- For example, 

1. Column filter: 

Let Kn= Ci X Di + C2X D2 . .. Cn X Dn and push or store Kn in a 
FIFO, such as one designated FIFO N in this example. 

2. Row filter: 

Let On = Ci X Ki + C2 X K2 . . . Cn X Kn and output signal samples 
On. 

From this approach, an N-tap column-filter employs N 
multiplications and N - 1 additions, for a software implementation, or 
one MAC in (2N - 1) clocks, for a hardware implementation, with the 
assumption that the MAC takes two clocks to do one multiplication 
and one addition. The operations of row-filters are similar to that of 
the column-filter. Therefore, this doubles the number of software 
computations or hardware MACs, depending upon the 
implementation, in order to get 2D-filter output data, which is the row 
filter output signal samples. 

Thus, for an implementation in software, a 3-tap 2D-filter employs 
6 multiplications and 4 additions, a 5-tap 2D-filter employs 10 
multiplications and 8 additions, and so on. Totally, the filter bank with 
M filters, thus, employs, for this embodiment: 

• 6 + 10 + 14 +. . . . + 2(2M + 1) = 2M^ + 4M multiplications, 
and 
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• 4 + 8 + 12 +.. ..+ 2(2M + 1 - 1) = 2M^ + 2M additions. 

For an implementation in hardware, a N-tap filter employs 2 MACs 
and (2N - 1) clocks to produce the desired output signal samples for a 
2D-filter. Totally, the filter bank witii M filters, thus, employs, for this 
embodiment: 

• 2M MACs, with a MAC containing one multiplier and one 

2-input adder, and 

• 2(2M + 1) - 1 = (4M + 1) clocks, which is also the number 
of clocks for the largest-tap filter, N = (2M +1), because all 
MACs can compute substantially simultaneously. 

In alternative embodiments, it may also be possible to reduce die 
number of MACs but it will increase the number of clocks. Although 
the hardware embodiments discussed are those that execute in the 
smallest number of clock cycles, the claimed subject matter is not 
limited in scope in this respect. 

FIG. 2 provides the coefficients for a filter bank with 5 filters. The 
input data for separated filters is also listed. The number of input 
samples for such a filter is equal to the number of coefficients of that 
filter. An input data or signal sample and its corresponding coefficient 
are put in the same column in FIG. 2. For example, for the F_7, the input 
data is [D.3, D.2, D.i, Do, Di, D2, D3] and the corresponding coefficients 
are [1, 2, 3, 4, 3, 2, 1]. According to the Eqs. 1 or 2, the ID-filtered data 
are the sum of products of an input data and its corresponding 
coefficient. In a shadowed box of FIG. 3, there is a single product of 
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input data and coefficient. To get the filter output signal sample, add up 
the input-coefficient-products in a row of the table. For example, the 
output signal sample of F_7 is (D.3 + 2D.2 + 3D.i + 4Do + 3Di + 2D2 + 
D3). 

On one particular embodiment, he observation above regarding FIG. 
3 provides a technique for producing the input and ou^ut signal samples 
of an individual filter by the following rules: 

1. Assume there is virtual filter, F_l, whose ou^ut signal sample is 
the input signal sample, Dq. 

2. The sum of input signal samples of a filter is obtained by adding 
its first and last input signal samples to the sum of input samples 
of its next lower-tap filter. 

3. The output signal sample of a filter is the sum of its input signal 
samples and the output signal sample of its next lower-tap filter. 

For example, the sum of input signal samples of F_3 is (D.i, + Do, + Di), 
the output signal sample of F_3 is (D.i + 2Do + Di), and the first and last 
input signal samples of F_5 are D.2 and D2. From rule 2, the sum of 
input signal samples of F_5 is (D.2 + D.i + Do + Di + D2), and then, from 
rule 3, the output signal sample of F_5 is (ID.2 + 2D.i + 3Do + 2Di + 
ID2). 

Based on die rules just mentioned, computing becomes straight- 
forward by computing the filter output signal sample from the lowest-tap 
filter and progressing to the next higher-tap filters. As described in more 
detail hereinafter, a filter bank with 5 filters is used to demonstrate how 
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to compute the output signal samples of the ID-filters, although this is 
merely an example and does not limit the scope of the claimed subject 
matter. For example, assume K3,f and S3 are, respectively, the output 
signal sample for column F and sum of the input signal samples of F_3, 
K5,F and S5 are, respectively, the output signal sample for column F and 
sum of input signal samples of F_5, and so on. Example pseudo code of 
a column-filter is as follows: 

ColumrLFilter(F) 

Begin // totally, 15 additions are employed. 

Let Ki,F= Do and S3 = D.i + Do + Di; 

Get K3,F = Ki,F + S3 and S5 = D.2+ S3 + D2; 
Get K5,F = Ksj. + S5 and S7 = D.3 + S5 + D3; 
Get K7,F = K5,F + S7 and S9 = D.4 + S7 + D4; 
Get K9,F = K7,F + S9 and Sn = D.5 + S9 + D5; 
GetKii.F = K9,F + Sii; 

End 

From above, the column-filter data for column 5, K3,f, Ksjf, K7JF, K9,f, 
and Kii,F, is obtained by fifteen additions, for software, or one 2-input 
adder and one 3-input adder in six clocks, for hardware. The above 
data for a filter bank with M filters leads to M output signal samples 
by: 

• (3 X M) additions, for a software implementation, or 

• One 2-input adder and one 3-input adder in (M + 1) clocks, for a 
hardware implementation. 
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In one particular embodiment, Kn p are pushed into separated 
FIFOs as described in more detail hereinafter, although, of course, the 
claimed subject matter is limited in scope in this respect. For example, 
the contents of FIFOs, after completing 1 1 columns of raw data, are 
listed in FIG. 4. The FIFOs are employed to store data relevant to the 
filters, although, in alternative embodiments, other storage techniques 
or hardware may be employed other than FIFOs. For example, FIFO 
3 in the table is for filter F_3, FIFO 5 is for F_5, and so on. 

As described in more detail hereinafter, the Kn,f wiU be passed, in 
this embodiment, to dedicated row filters for producing the 2D-filter 
output signal samples, although, again, the claimed subject matter is 
not limited in scope in this respect. For example, it is not necessary 
that dedicated row filters be employed. The computations for the row- 
filter are similar to that for the column-filter. However, unlike for the 
column-filter, the N-tap row-filter computes the center N data in thr 
FIFO. For example, the 3-tap row-filter employs [Ks .i^ K3 o, K3 1 ]. 
Because an N-tap filter employs N input signal samples around the 
center, input signal samples beyond that range are ignored in this 
embodiment. This is depicted in FIG. 4 through the use of shading. 

Assume O3 and O5 are 2D-output signal samples from 3-tap and 5- 
tap row-filters, respectively. Example pseudo code to produce these 
signal samples is provided below. For the other tap row-filters, output 
signal samples may be derived similarly: 
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RowFilter(N) 

Besin 

switch(N) 
{ 

case 3: 

LetOs 
GetOg 

case 5: 

LetOs 
GetOs 
GetOs 

case?: .... 

case 9: .... 

} 

End. 



Therefore, for a software implementation of a filter bank with 
M filters, the row-filters employ (3xl+3x2+...+3xM)= 3M(M 
+ l)/2 additions and the column-filter employs (3 x M) additions. In 
total, 3M(M + 3)/2 additions are employed in order to get M 2D-filter 
data for (2M + 1) x (2M + 1) matrix input signal samples. For a 
hardware implementation, a colunm or row filter contains a 2-input 
adder and a 3-input adder. Thus, the data of one column and M row- 
filters may be computed concurrently because they are independent 
from each other. In the other words, the total clocks employed for a 
filter bank with M filters may be the same as the number of clocks 



// 3 additions in total 
= Ks^o ^iid S3 = K3^.i + Ks^o + K3J; 
= O3+ S3; break; 

// 6 additions in total 
= K5,o and S5 = K5,.i + K5,o + Ks^; 
= O5+ S5 and S5 = K5,-2 + K5,o + K5,2; 
= O5+ S5; break; 
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employed for the longest-tap filter, for example, the F_l 1 in the 
example above. Therefore, a hardware implementation may employ: 

1. (M + 1) column and row filters, a filter containing one 2- 
input adder and one 3-input adder. 

2. (M + 1) clocks to compute M 2D-filter output signal 
samples for (2M + 1) x (2M +1) matrix input signal 
samples. 

With the approach of the previously described embodiment, the 
computation for 2D-filter bank becomes relatively straight-forward. 
One possible software implementation is explained below in the form 
of pseudo-code, although, this is just an example, and the claimed 
subject matter is not limited in scope to this implementation. The 
progressive 2D-filter bank scheme is illustrated for this embodiment 
by the italics. In order to easily explain the pseudo-code, assume 
there are M filters in filter bank and the filter taps are 3,5,... and (2M 
+ 1), respectively. 

Begin 

Set M = number of filters in filter bank; 

Input (2M +1) rows of raw data and save them in buffer; 

do{ 

Set K = the number of columns of raw data; 
for(n = 0; n < (2M + 1); n++) ColumnFiter(n); //compute 
(2M + 1) column-filters 
do{ 
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RowFilter(3); //compute M ID-filter output 

signal samples for 1 pixel 
RowFilte(5); 

RowFilter(2M+ 1); 

ColumnFilter( n + + j; //compute next column filter for 
next M ID-filter output signal samples 

} while(n < K); //repeat until complete all columns 

(all 2D-filter outputs in row) 

Discard the 1^^ row data in the buffer; 

Input one new row of raw data, save it as the last row data in 
the buffer; 

} while (not last row); //repeat until complete all rows 

End. 



FIG. 5 shows a block diagram of an embodiment of a progressive 
2D-filter bank with 5 filters. The unit names of colunm and row 
FIFOs are [F5, F4, F3, F2, Fi, Fq, F.i, F.2, F.3, F.4, F_5]. The units with 
the same names but in different FIFOs contain different data. The 
detail of the controller is not shown in order not to obscure the 
claimed subject matter; however, in this embodiment, the controller is 
able to make the FIFOs and colunm raw data array repeat the 
following pattem: 

1 . 1^^ clock: output data in F4, Fo, and Fi. 

2. 2 clock: output data in F_2, and F2, 
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3. 3^^ clock: output data in R3, and F3, 

4 and so on. 

The circuitry in column filter and row filters are similar but the 3-tap 
row-filter outputs data at the l"""^ clock, the 5-tap row-filter outputs 
data at the 3^^ clock, and so on. The column-filter pushes its output 
data to FIFO-3 at the 2^^ clock, to FIFO-5 at the 3'"^ clock and so on. 
The diagram of one possible embodiment of a column filter or row 
filter is shown in FIG. 6, where Dn represents the data output from the 
unit Fn in FIFO and n is an integer between -5 and 5. Of course, the 
claimed subject matter is not limited in scope to the a-column or row 
filter embodiment shown. 

The previously described embodiment of a 2D-filter scheme for 
a pyramid filter bank has several advantages over the traditional 2D- 
filter in terms of the number of computations and computing speed for 
software and hardware implementations. Referring to FIG. 7, the 
advantages of the progressive scheme for filter bank include the 
following: 

Reduced number of computations: For a software 
implementation, the previously described embodiment of a 
progressive 2D-filter bank reduces the numbers of computations. For 
example, the reducing ratio is about 2:1 (130:60) if M = 5; 

Increased computing speed: For a software implementation, the 
previously described embodiment of a progressive 2D-filter bank 
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Utilizes less time to calculate because of both a fewer number of 
computations and because additions are employed instead of 
multiplications. For a hardware implementation, its execution time is 
about one quarter (6:21) of that for the traditional one if M = 5; 

Reduction in number of gates: For a hardware implementation 
of a filter, the gate count of a multiplier is larger than that of an adder. 
As indicated, therefore, the previously described embodiment of a 
progressive 2D-filter may avoid using multipliers or multiplication 
and reduce gate count. 

It will, of course, be understood that, although particular embodiments 
have just been described, the claimed subject matter is not limited in scope 
to a particular embodiment or implementation. For example, one 
embodiment may be in hardware, whereas another embodiment may be in 
software. Likewise, an embodiment may be in firmware, or any 
combination of hardware, software, or firmware, for example. Likewise, 
although the claimed subject matter is not limited in scope in this respect, 
one embodiment may comprise an article, such as a storage medium. Such a 
storage medium, such as, for example, a CD-ROM, or a disk, may have 
stored thereon instmctions, which when executed by a system, such as a 
computer system or platform, or a computing system, for example, may 
result in an embodiment of a method in accordance with the claimed subject 
matter being executed, such as an embodiment of a method of filtering pixel 
data, for example, as previously described. For example, an image 
processing platform or an image processing system may include an image 
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processing unit, an image or video input/output device and/or memory. 

While certain features of the claimed subject matter have been 
illustrated and described herein, many modifications, substitutions, changes 
and equivalents will now occur to those skilled in the art. It is, therefore, to 
be understood that the appended claims are intended to cover all such 
modifications and changes as fall within the true spirit of the claimed subject 
matter. 
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